R DATA VISUALIZATION

Why Data Visualization?

Raw data point doesn’t provide much insight to kick off data analysis.

Data Visualization is brilliant in * exploring the pattern of data briefly at the early stage * in the final conclusion, enhance the story telling of data analysis (inforgraphics play a huge role for this purpose)

Reminder on Workflow Again

R Data Science Workflow

Built-in Plot Functions

The advantage of using built-in plotting utilities is they are easy. It let you quickly visualize the data pattern while you are trying to gain a brief insight at the early stage of your workflow.

Reflash on Built-in Plot Tools

For built-in R data visualization, go to the R Programming Intro project on Github to reflash your memory (R Intro Source Codes)[https://github.com/ngsanluk/R-Intro]

Grammar of Graphics: ggplot2

If these built-in plotting tools are not enough for you,  Go to ggplot2. It is the most popular data visualization for R.

ggplot2 is an open-source data visualization package for R. A data visualization which breaks up graphs into semantic components such as scales and layers.  Since 2005, ggplot2 has grown in use to become one of the most popular R packages.

ggplot2 Cheat Sheet

ggplot 2 cheat sheet


BASIC GRAMMAR

ggplot2 is based on the grammar of graphics, the idea that you can build every graph from the same components below:

a data set + a coordinate system + and geoms—visual marks that represent data points

Grammar of Graphics

Use Built-in Datasets

Let’s use the built-in cars data set for a simple ggplot

geom_point() function

It’s easy to add geometry layer to the base co-ordinate
Let’s ADD a layer of data points using geom_point() function.

And Yes, you can ADD a layer by using the + operator We use geom_point() function that required x and y value for each point. In 2D co-ordinate, a point is described by its x and y value.

We need to provide a mapping that specifies the data columns’ name to map to a point’s the x and y value

That mapping is defined by an aesthetics function
aes()

Scatterplot is useful to explore the relation of two variables.

Use geom_line() to replace geom_point()

geom_point() and geom_line() require very similar parameters.
geom_line() is simply an enhanced visualization that automatically connect all the points

Use geom_smoth() to project a smooth line

again geom_smooth() and geom_point() require very similar parameters.
geom_smooth() smooths out the line progression

cars %>% ggplot() +
  geom_smooth(mapping = aes(x=speed, y=dist))
`geom_smooth()` using method = 'loess' and formula 'y ~ x'

Adding Multiple Layers

# just change geom_point to geom_line without change anything else
cars %>% ggplot() +
  geom_point(mapping = aes(x=speed, y=dist)) +
  geom_smooth(mapping = aes(x=speed, y=dist)) 
`geom_smooth()` using method = 'loess' and formula 'y ~ x'

Adding Aesthetics to your Plots

Un-comment the extra parameters to add more aesthetics to your plot

cars %>% ggplot() +
  geom_point(mapping = aes(x=speed, y=dist),
             color = "orange", # the color of data points
             # size = 3, # the size of data point
             # alpha = 0.5, # the transparency of data points, min=0, max=1
             # shape = 0, # the shape of data point
             )


PLOT WITH OUR OWN DATA

Loading Data: allowance & graduates

Allowance Data Set in Simple Scatterplot

Continuous Values vs. Discrete Values

Continuous values refer to numbers value that has wide range. E.g. salary, height Discrete values refer to a limited number of valid values. It can be string. It can be a few distinct numbers.

When you produce plots, pay attention to what type of value are required by the geoms.

In many cases, you will need to convert the data first. mutate() function are quite often used for that.

example:

allowance = allowance %>% 
  mutate(Assessment_Year = as.numeric(substr(Assessment_Year, 1 ,4))) 

Simple Line Plot

Adding Multiple Layers of Geometry

allowance %>% ggplot() +
  geom_line(mapping = aes(x=Assessment_Year, y=Basic, group=1, color="Orange")) +
  geom_point(mapping = aes(x=Assessment_Year, y=Basic, group=1, color="Orange"))


# As both geom use the same data mapping, the above statements can be simplified as
allowance %>% ggplot(aes(x=Assessment_Year, y=Basic, group=1, color="Orange")) +
  geom_line() +
  geom_point(size=5)

Use geom_smooth() to smooth out the line

allowance %>% ggplot(aes(x=Assessment_Year, y=Basic, group=1, color="Orange")) +
  geom_smooth() +
  geom_point(size=5)
`geom_smooth()` using method = 'loess' and formula 'y ~ x'

Save a Plot: ggsave()

ggsave("./output/my_first_plot.png") # default image size
Saving 7 x 7 in image

Bar Chart with geom_col()

geom_bar()

geom_bar() is used for counting the frequency of each occurrence of observed value. It’s usually for counting a limit set of value


CHALLENGE

Multiple Layers of Lines

add line plot for column of Child in the same plot, add another line plot for Dependent_Parent_60

allowance %>% ggplot() +
  geom_line(mapping = aes(x=Assessment_Year, y=Child, group=1), color="Orange") + 
  geom_line(mapping = aes(x=Assessment_Year, y=Dependent_Parent_60, group=1), color="Blue") 


WORK WITH MORE COMPLEX DATA

Loading Data: graduates.csv

graduates = read_csv("./data/graduates.csv")
Rows: 601 Columns: 5
── Column specification ────────────────────────────────────────────────────────────────────
Delimiter: ","
chr (4): AcademicYear, LevelOfStudy, ProgrammeCategory, Sex
dbl (1): Headcount

ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.

Simple Scatterplot

Let’s explore the data with some simple ggplot plot. Overall they are not very useful. Just some quick exploration.

Use filter() to Extract Required Rows

CHALLENGE

Comparison with Line Plots

Use line plots to compare female undergraduate students headcount trending in ProgrammeCategory of “Business and Management” and “Engineering and Technology” Use filter() to extract required record You can use multiple filter() call Use &, | or multiple conditions

graduates %>% 
  .$ProgrammeCategory %>% 
  unique() # display the unique names of ProgrammeCategory
[1] "Arts and Humanities"            "Business and Management"       
[3] "Education"                      "Engineering and Technology"    
[5] "Medicine, Dentistry and Health" "Sciences"                      
[7] "Social Sciences"               
graduates %>% 
  filter(LevelOfStudy=="Undergraduate", Sex=="F") %>%
  filter(ProgrammeCategory=="Business and Management" | ProgrammeCategory=="Engineering and Technology") %>% 
  print() # Test extracting and printing the required records.


CHALLENGE: line plot for hibor_fixing_1m

library(jsonlite) # load package
hkma.interbank.url = "https://api.hkma.gov.hk/public/market-data-and-statistics/daily-monetary-statistics/daily-figures-interbank-liquidity"
interbank.liquidity = fromJSON(hkma.interbank.url)
# the above retrieval will take a while.  The server response is slow.
summary(interbank.liquidity)
       Length Class  Mode
header 3      -none- list
result 2      -none- list
str(interbank.liquidity)
List of 2
 $ header:List of 3
  ..$ success : logi TRUE
  ..$ err_code: chr "0000"
  ..$ err_msg : chr "No error found"
 $ result:List of 2
  ..$ datasize: int 100
  ..$ records :'data.frame':    100 obs. of  44 variables:
  .. ..$ end_of_date                                    : chr [1:100] "2022-03-30" "2022-03-29" "2022-03-28" "2022-03-25" ...
  .. ..$ cu_weakside                                    : num [1:100] 7.85 7.85 7.85 7.85 7.85 7.85 7.85 7.85 7.85 7.85 ...
  .. ..$ cu_strongside                                  : num [1:100] 7.75 7.75 7.75 7.75 7.75 7.75 7.75 7.75 7.75 7.75 ...
  .. ..$ disc_win_base_rate                             : num [1:100] 0.75 0.75 0.75 0.75 0.75 0.75 0.75 0.75 0.75 0.75 ...
  .. ..$ hibor_overnight                                : num [1:100] 0.03 0.02 0.02 0.02 0.02 0.02 0.02 0.01 0.03 0.02 ...
  .. ..$ hibor_fixing_1m                                : num [1:100] 0.313 0.312 0.313 0.323 0.319 ...
  .. ..$ twi                                            : num [1:100] 95.3 95.7 95.9 95.6 95.7 95.7 95.6 95.5 95.4 95.4 ...
  .. ..$ opening_balance                                : int [1:100] 337534 337534 337534 337534 337534 337536 337553 337538 337538 337538 ...
  .. ..$ closing_balance                                : int [1:100] 337551 337534 337534 337534 337534 337534 337536 337553 337538 337538 ...
  .. ..$ market_activities                              : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ interest_payment                               : chr [1:100] "+16" "+0" "+0" "+0" ...
  .. ..$ discount_window_reversal                       : chr [1:100] "-0" "-0" "-0" "-0" ...
  .. ..$ discount_window_activities                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ intraday_movements_of_aggregate_balance_at_0930: int [1:100] 363880 350696 357104 354934 363276 355552 353301 352138 351573 353926 ...
  .. ..$ intraday_movements_of_aggregate_balance_at_1000: int [1:100] 366723 358279 358428 358128 363476 361781 356632 356870 353300 355233 ...
  .. ..$ intraday_movements_of_aggregate_balance_at_1100: int [1:100] 383598 376635 375870 374775 374465 377616 374645 370373 371865 373477 ...
  .. ..$ intraday_movements_of_aggregate_balance_at_1200: int [1:100] 331056 383952 385132 383777 383416 323375 375169 381656 378485 395569 ...
  .. ..$ intraday_movements_of_aggregate_balance_at_1500: int [1:100] 334817 391180 389282 382202 390063 335473 391970 403349 403099 398017 ...
  .. ..$ intraday_movements_of_aggregate_balance_at_1600: int [1:100] 337197 392468 391754 383194 391833 337396 392436 403610 409198 401337 ...
  .. ..$ forex_trans_t1                                 : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ other_market_activities_t1                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ reversal_of_discount_window_t1                 : chr [1:100] "-0" "-0" "-0" "-0" ...
  .. ..$ interest_payment_issuance_efbn_t1              : chr [1:100] "+0" "+16" "+0" "+0" ...
  .. ..$ forecast_aggregate_bal_t1                      : int [1:100] 337551 337551 337534 337534 337534 337534 337534 337536 337536 337538 ...
  .. ..$ forex_trans_t2                                 : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ other_market_activities_t2                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ reversal_of_discount_window_t2                 : chr [1:100] "-0" "-0" "-0" "-0" ...
  .. ..$ interest_payment_issuance_efbn_t2              : chr [1:100] "+0" "+0" "+7" "+0" ...
  .. ..$ forecast_aggregate_bal_t2                      : int [1:100] 337551 337551 337541 337534 337534 337534 337534 337529 337536 337536 ...
  .. ..$ forex_trans_t3                                 : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ other_market_activities_t3                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ reversal_of_discount_window_t3                 : chr [1:100] "-0" "-0" "-0" "-0" ...
  .. ..$ interest_payment_issuance_efbn_t3              : chr [1:100] "+0" "+0" "+0" "+7" ...
  .. ..$ forecast_aggregate_bal_t3                      : int [1:100] 337551 337551 337541 337541 337534 337534 337534 337529 337529 337536 ...
  .. ..$ forex_trans_t4                                 : chr [1:100] NA NA NA NA ...
  .. ..$ other_market_activities_t4                     : chr [1:100] NA NA NA NA ...
  .. ..$ reversal_of_discount_window_t4                 : chr [1:100] NA NA NA NA ...
  .. ..$ interest_payment_issuance_efbn_t4              : chr [1:100] NA NA NA NA ...
  .. ..$ forecast_aggregate_bal_t4                      : int [1:100] NA NA NA NA NA NA NA NA NA NA ...
  .. ..$ forex_trans_u                                  : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ other_market_activities_u                      : chr [1:100] "+0" "+0" "+0" "+0" ...
  .. ..$ reversal_of_discount_window_u                  : chr [1:100] "-0" "-0" "-0" "-0" ...
  .. ..$ interest_payment_issuance_efbn_u               : chr [1:100] "-72" "-72" "-62" "-62" ...
  .. ..$ forecast_aggregate_bal_u                       : int [1:100] 337479 337479 337479 337479 337479 337479 337479 337479 337479 337479 ...
interbank.liquidity$result
$datasize
[1] 100

$records
str(interbank.liquidity$result)
List of 2
 $ datasize: int 100
 $ records :'data.frame':   100 obs. of  44 variables:
  ..$ end_of_date                                    : chr [1:100] "2022-03-30" "2022-03-29" "2022-03-28" "2022-03-25" ...
  ..$ cu_weakside                                    : num [1:100] 7.85 7.85 7.85 7.85 7.85 7.85 7.85 7.85 7.85 7.85 ...
  ..$ cu_strongside                                  : num [1:100] 7.75 7.75 7.75 7.75 7.75 7.75 7.75 7.75 7.75 7.75 ...
  ..$ disc_win_base_rate                             : num [1:100] 0.75 0.75 0.75 0.75 0.75 0.75 0.75 0.75 0.75 0.75 ...
  ..$ hibor_overnight                                : num [1:100] 0.03 0.02 0.02 0.02 0.02 0.02 0.02 0.01 0.03 0.02 ...
  ..$ hibor_fixing_1m                                : num [1:100] 0.313 0.312 0.313 0.323 0.319 ...
  ..$ twi                                            : num [1:100] 95.3 95.7 95.9 95.6 95.7 95.7 95.6 95.5 95.4 95.4 ...
  ..$ opening_balance                                : int [1:100] 337534 337534 337534 337534 337534 337536 337553 337538 337538 337538 ...
  ..$ closing_balance                                : int [1:100] 337551 337534 337534 337534 337534 337534 337536 337553 337538 337538 ...
  ..$ market_activities                              : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ interest_payment                               : chr [1:100] "+16" "+0" "+0" "+0" ...
  ..$ discount_window_reversal                       : chr [1:100] "-0" "-0" "-0" "-0" ...
  ..$ discount_window_activities                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ intraday_movements_of_aggregate_balance_at_0930: int [1:100] 363880 350696 357104 354934 363276 355552 353301 352138 351573 353926 ...
  ..$ intraday_movements_of_aggregate_balance_at_1000: int [1:100] 366723 358279 358428 358128 363476 361781 356632 356870 353300 355233 ...
  ..$ intraday_movements_of_aggregate_balance_at_1100: int [1:100] 383598 376635 375870 374775 374465 377616 374645 370373 371865 373477 ...
  ..$ intraday_movements_of_aggregate_balance_at_1200: int [1:100] 331056 383952 385132 383777 383416 323375 375169 381656 378485 395569 ...
  ..$ intraday_movements_of_aggregate_balance_at_1500: int [1:100] 334817 391180 389282 382202 390063 335473 391970 403349 403099 398017 ...
  ..$ intraday_movements_of_aggregate_balance_at_1600: int [1:100] 337197 392468 391754 383194 391833 337396 392436 403610 409198 401337 ...
  ..$ forex_trans_t1                                 : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ other_market_activities_t1                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ reversal_of_discount_window_t1                 : chr [1:100] "-0" "-0" "-0" "-0" ...
  ..$ interest_payment_issuance_efbn_t1              : chr [1:100] "+0" "+16" "+0" "+0" ...
  ..$ forecast_aggregate_bal_t1                      : int [1:100] 337551 337551 337534 337534 337534 337534 337534 337536 337536 337538 ...
  ..$ forex_trans_t2                                 : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ other_market_activities_t2                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ reversal_of_discount_window_t2                 : chr [1:100] "-0" "-0" "-0" "-0" ...
  ..$ interest_payment_issuance_efbn_t2              : chr [1:100] "+0" "+0" "+7" "+0" ...
  ..$ forecast_aggregate_bal_t2                      : int [1:100] 337551 337551 337541 337534 337534 337534 337534 337529 337536 337536 ...
  ..$ forex_trans_t3                                 : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ other_market_activities_t3                     : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ reversal_of_discount_window_t3                 : chr [1:100] "-0" "-0" "-0" "-0" ...
  ..$ interest_payment_issuance_efbn_t3              : chr [1:100] "+0" "+0" "+0" "+7" ...
  ..$ forecast_aggregate_bal_t3                      : int [1:100] 337551 337551 337541 337541 337534 337534 337534 337529 337529 337536 ...
  ..$ forex_trans_t4                                 : chr [1:100] NA NA NA NA ...
  ..$ other_market_activities_t4                     : chr [1:100] NA NA NA NA ...
  ..$ reversal_of_discount_window_t4                 : chr [1:100] NA NA NA NA ...
  ..$ interest_payment_issuance_efbn_t4              : chr [1:100] NA NA NA NA ...
  ..$ forecast_aggregate_bal_t4                      : int [1:100] NA NA NA NA NA NA NA NA NA NA ...
  ..$ forex_trans_u                                  : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ other_market_activities_u                      : chr [1:100] "+0" "+0" "+0" "+0" ...
  ..$ reversal_of_discount_window_u                  : chr [1:100] "-0" "-0" "-0" "-0" ...
  ..$ interest_payment_issuance_efbn_u               : chr [1:100] "-72" "-72" "-62" "-62" ...
  ..$ forecast_aggregate_bal_u                       : int [1:100] 337479 337479 337479 337479 337479 337479 337479 337479 337479 337479 ...
interbank.records = interbank.liquidity$result$records %>% as_tibble()
interbank.records

interbank.records %>% 
ggplot() +
  geom_line(
    mapping=aes(x=end_of_date, y=hibor_fixing_1m, group=1),
    color="orange"
             )


GROUPING AND AGGREGATION

Using group_by() and summarise()

graduates %>% group_by(AcademicYear, LevelOfStudy) %>% 
  summarise(TotalHeadcount = sum(Headcount)) %>% 
  ggplot(
    aes(x=AcademicYear, 
             y=TotalHeadcount,
             group=LevelOfStudy, 
             color=LevelOfStudy
             )
    ) +
    geom_line() +
    geom_point() 
`summarise()` has grouped output by 'AcademicYear'. You can override using the `.groups`
argument.

Use of filter()

Use filter() to keep only “Taught Postgraduate” Records

This plot is not very useful without previously applying filter() and group_by() and summarise()

filter() + group_by() + summarise()

Use filter() to extract required rows Use group_by() and summarise() to group and aggreate total headcout for both male and female


graduates %>% 
  filter(LevelOfStudy=="Taught Postgraduate") %>% 
  group_by(AcademicYear, ProgrammeCategory) %>% 
  summarise(TotalHeadcount = sum(Headcount)) %>% 
  ggplot() +
    geom_line(mapping=aes(x=AcademicYear,y=TotalHeadcount, group=ProgrammeCategory, color=ProgrammeCategory))
`summarise()` has grouped output by 'AcademicYear'. You can override using the `.groups`
argument.

graduates %>%
  filter(LevelOfStudy=="Undergraduate") %>%
  group_by(AcademicYear, ProgrammeCategory) %>%
  summarise(TotalHeadcount = sum(Headcount)) %>%
  ggplot() +
    geom_line(mapping=aes(x=AcademicYear,y=TotalHeadcount, group=ProgrammeCategory, color=ProgrammeCategory))
`summarise()` has grouped output by 'AcademicYear'. You can override using the `.groups`
argument.

NA

geom_col() function

More Aggregation Functions

Center: mean(), median() Spread: sd(), IQR(), mad() Range: min(), max(), quantile() Position: first(), last(), nth(), Count: n(), n_distinct() Logical: any(), all()

More information at summarise() function

geom_bar() function

bar chart give the counting frequency (number of record in the data set)

box plot

The boxplot compactly displays the distribution of a continuous variable. It visualises five summary statistics (the median, two hinges and two whiskers), and all “outlying” points individually.


MAKE IT PRETTY

Use of title, label, background color and themes

Plot Background

element_rect() is a function to generated rectangle geometry element. You have to specify the fill parameter by color name or hex code code by string

Plot Background refers to the big area of everything relevant to the plot.

Panel Background

Panel background refers to the inner area of plot. Area for showing header, axis lable and legend are NOT included.

level.bar.plot # default style
level.bar.plot # default style

level.bar.plot +
  theme(panel.background = element_rect(fill="orange")) # styling the panel background

Remove Plot and Panel Background

In visual design, color is very powerful tool to guide users’ attention. But you have to use them carefully.

Too many colors will usually do the opposite - confuse the audience. Minimal design is the recent trend. Expecially true when many are using small device like mobile phone for day-to-day communication.

In this example, we are removing both plot and panel background to achieve a clean design. After all, background is the main dish. Very often background color causes distraction to graph.

Change Label for x/y Axis

level.bar.plot # default style


level.bar.plot +
  theme(panel.background = element_blank()) + # styling the panel background to none
  theme(plot.background = element_blank()) + # styling the plot background to none
  theme(panel.grid.major.y = element_line(color="grey")) + # styling the grid line for y-axis
  ylab("Number of Student") + # Label for Y axis
  xlab("Year") # Label for X axis

Change Fill Colors

level.bar.plot # default style


level.bar.plot +
  theme(panel.background = element_blank()) + # styling the panel background to none
  theme(plot.background = element_blank()) + # styling the plot background to none
  theme(panel.grid.major.y = element_line(color="grey")) + # styling the grid line for y-axis
  ylab("Number of Student") + # Label for Y axis
  xlab("Year") + # Label for X axis
  scale_fill_manual(values=c("purple", "orange", "blue", "tomato"))

Styling The Legends

level.bar.plot # default style


level.bar.plot +
  theme(panel.background = element_blank()) + # styling the panel background to none
  theme(plot.background = element_blank()) + # styling the plot background to none
  theme(panel.grid.major.y = element_line(color="grey")) + # styling the grid line for y-axis
  ylab("Number of Student") + # Label for Y axis
  xlab("Year") + # Label for X axis
  theme(legend.position="top") +
  scale_fill_manual(values=c("purple", "orange", "blue", "tomato"),
                    guide = guide_legend(title="Level of Study", 
                                         label.position = "bottom")
                    )

NA

Add Title and Subtitle

level.bar.plot # default style


level.bar.plot +
  theme(panel.background = element_blank()) + # styling the panel background to none
  theme(plot.background = element_blank()) + # styling the plot background to none
  theme(panel.grid.major.y = element_line(color="grey")) + # styling the grid line for y-axis
  ylab("Number of Student") + # Label for Y axis
  xlab("Year") + # Label for X axis
  theme(legend.position="top") +
  scale_fill_manual(values=c("purple", "orange", "blue", "tomato"),
                    guide = guide_legend(title="Level of Study", 
                                         label.position = "bottom")
                    ) + # move legend position to top and label position to bottom 
  ggtitle("Hong Kong Higher Education Student Headcount", subtitle="2009 - 2019")

Add Annotations Texts

Add extra texts/shape to enhance your visualization

level.bar.plot # default style


level.bar.plot +
  theme(panel.background = element_blank()) + # styling the panel background to none
  theme(plot.background = element_blank()) + # styling the plot background to none
  theme(panel.grid.major.y = element_line(color="grey")) + # styling the grid line for y-axis
  ylab("Number of Student") + # Label for Y axis
  xlab("Year") + # Label for X axis
  theme(legend.position="top") +
  scale_fill_manual(values=c("purple", "orange", "blue", "tomato"),
                    guide = guide_legend(title="Level of Study", 
                                         label.position = "bottom")
                    ) + # move legend position to top and label position to bottom 
  ggtitle("Hong Kong Higher Education Student Headcount", subtitle="2009 - 2019") + 
  annotate("text", label="Record\nHigh", x="2017/18", y=5300) # you can change value of x and y to set the text position

Adding Reference Lines

Using Themes

level.bar.plot # default style


level.bar.plot +
  theme_bw() # black and white theme


level.bar.plot +
  theme_minimal() # black and white theme


level.bar.plot +
  theme_dark() # black and white theme

More 3rd-party Themes

Install ggthemes package to unlock wider selections of themes.

if (!require("pacman")) install.packages("pacman") # check if pacman already installed. If not, install it.
pacman::p_load(ggthemes)

level.bar.plot # default style


level.bar.plot +
  theme_excel() + # Excel Theme
  ggtitle("Excel Theme")

  

level.bar.plot +
  theme_wsj() + # Wall Street Journal Theme
  ggtitle("Wall Street Journal Theme")


level.bar.plot +
  theme_economist() + # Economist Theme
  ggtitle("Economist Theme")


level.bar.plot +
  theme_fivethirtyeight() + # Five Thirty Eight
  ggtitle("Five Thirty Eight Theme")


MORE RESOURCES ON ggplot2

official website

browseURL("https://ggplot2.tidyverse.org/")

extentsions

browseURL("https://exts.ggplot2.tidyverse.org/")

MODELING


TO CONTINUE

unnest()

Categorical Variable

Recoding Data

Scaling

Transforming Outliers

LS0tCnRpdGxlOiAiUiBJbnRlcm1lZGlhdGUgLSBEYXkgMiIKb3V0cHV0OiBodG1sX25vdGVib29rCi0tLQoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgoKIyBSIERBVEEgVklTVUFMSVpBVElPTgoKIyMgV2h5IERhdGEgVmlzdWFsaXphdGlvbj8KUmF3IGRhdGEgcG9pbnQgZG9lc24ndCBwcm92aWRlIG11Y2ggaW5zaWdodCB0byBraWNrIG9mZiBkYXRhIGFuYWx5c2lzLlwKCkRhdGEgVmlzdWFsaXphdGlvbiBpcyBicmlsbGlhbnQgaW4KKiBleHBsb3JpbmcgdGhlIHBhdHRlcm4gb2YgZGF0YSBicmllZmx5IGF0IHRoZSBlYXJseSBzdGFnZQoqIGluIHRoZSBmaW5hbCBjb25jbHVzaW9uLCBlbmhhbmNlIHRoZSBzdG9yeSB0ZWxsaW5nIG9mIGRhdGEgYW5hbHlzaXMgKGluZm9yZ3JhcGhpY3MgcGxheSBhIGh1Z2Ugcm9sZSBmb3IgdGhpcyBwdXJwb3NlKQoKIyMgUmVtaW5kZXIgb24gV29ya2Zsb3cgQWdhaW4KCiFbUiBEYXRhIFNjaWVuY2UgV29ya2Zsb3ddKGh0dHBzOi8vZDMzd3VicmZraTBsNjguY2xvdWRmcm9udC5uZXQvNTcxYjA1Njc1N2Q2OGU2ZGY4MWEzZTM4NTNmNTRkM2M3NmFkNmVmYy8zMmQzNy9kaWFncmFtcy9kYXRhLXNjaWVuY2UucG5nKQoKIyMgQnVpbHQtaW4gUGxvdCBGdW5jdGlvbnMKVGhlIGFkdmFudGFnZSBvZiB1c2luZyBidWlsdC1pbiBwbG90dGluZyB1dGlsaXRpZXMgaXMgdGhleSBhcmUgZWFzeS4KSXQgbGV0IHlvdSBxdWlja2x5IHZpc3VhbGl6ZSB0aGUgZGF0YSBwYXR0ZXJuIHdoaWxlIHlvdSBhcmUgdHJ5aW5nIHRvIGdhaW4gYSBicmllZiBpbnNpZ2h0IGF0IHRoZSBlYXJseSBzdGFnZSBvZiB5b3VyIHdvcmtmbG93LgpgYGB7cn0KcGxvdChpcmlzKQpgYGAKCiMjIFJlZmxhc2ggb24gQnVpbHQtaW4gUGxvdCBUb29scwpGb3IgYnVpbHQtaW4gUiBkYXRhIHZpc3VhbGl6YXRpb24sIGdvIHRvIHRoZSAqKlIgUHJvZ3JhbW1pbmcgSW50cm8qKiBwcm9qZWN0IG9uIEdpdGh1YiB0byByZWZsYXNoIHlvdXIgbWVtb3J5CihSIEludHJvIFNvdXJjZSBDb2RlcylbaHR0cHM6Ly9naXRodWIuY29tL25nc2FubHVrL1ItSW50cm9dCgoKIyMgR3JhbW1hciBvZiBHcmFwaGljczogZ2dwbG90MgoKSWYgdGhlc2UgYnVpbHQtaW4gcGxvdHRpbmcgdG9vbHMgYXJlIG5vdCBlbm91Z2ggZm9yIHlvdSxcIApHbyB0byAqKmdncGxvdDIqKi4gSXQgIGlzIHRoZSBtb3N0IHBvcHVsYXIgZGF0YSB2aXN1YWxpemF0aW9uIGZvciBSLgoKZ2dwbG90MiBpcyBhbiBvcGVuLXNvdXJjZSBkYXRhIHZpc3VhbGl6YXRpb24gcGFja2FnZSBmb3IgUi4gCkEgZGF0YSB2aXN1YWxpemF0aW9uIHdoaWNoIGJyZWFrcyB1cCBncmFwaHMgaW50byBzZW1hbnRpYyBjb21wb25lbnRzIHN1Y2ggYXMgKipzY2FsZXMqKiBhbmQgKipsYXllcnMqKi5cIApTaW5jZSAyMDA1LCBnZ3Bsb3QyIGhhcyBncm93biBpbiB1c2UgdG8gYmVjb21lIG9uZSBvZiB0aGUgbW9zdCBwb3B1bGFyIFIgcGFja2FnZXMuCgoKIyMgZ2dwbG90MiBDaGVhdCBTaGVldAoKW2dncGxvdCAyIGNoZWF0IHNoZWV0XShodHRwczovL2dpdGh1Yi5jb20vcnN0dWRpby9jaGVhdHNoZWV0cy9ibG9iL21haW4vZGF0YS12aXN1YWxpemF0aW9uLTIuMS5wZGYpCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCiMgQkFTSUMgR1JBTU1BUgpnZ3Bsb3QyIGlzIGJhc2VkIG9uIHRoZSBncmFtbWFyIG9mIGdyYXBoaWNzLCB0aGUgaWRlYSB0aGF0IHlvdSBjYW4gYnVpbGQgZXZlcnkgZ3JhcGggZnJvbSB0aGUgc2FtZSBjb21wb25lbnRzIGJlbG93OiAKCioqYSBkYXRhIHNldCoqIAorIAoqKmEgY29vcmRpbmF0ZSBzeXN0ZW0qKiAKKyAKKiphbmQgZ2VvbXPigJR2aXN1YWwgbWFya3MgdGhhdCByZXByZXNlbnQgZGF0YSBwb2ludHMqKgoKIVtHcmFtbWFyIG9mIEdyYXBoaWNzXShodHRwczovL2p1bGVzMzIuZ2l0aHViLmlvL3ItZm9yLWV4Y2VsLXVzZXJzL2ltZy9yc3R1ZGlvLWNoZWF0c2hlZXQtZ2dwbG90LnBuZykKCgojIyBVc2UgQnVpbHQtaW4gRGF0YXNldHMKTGV0J3MgdXNlIHRoZSBidWlsdC1pbiBjYXJzIGRhdGEgc2V0IGZvciBhIHNpbXBsZSBnZ3Bsb3QKCmBgYHtyfQpwcmludChjYXJzKQpgYGAKCmBgYHtyIEdlbmVyYXRpbmcgRW1wdHkgUGxvdH0KY2FycyAlPiUgZ2dwbG90KCkgIyBUaGlzIG9ubHkgc3BlY2lmaWVzIGEgZGF0YSBzZXQgYW5kIGEgY29vcmRpbmF0ZSBzeXN0ZW0gYW5kIHRoZXJlZm9yZSBhbiBlbXB0eSBwbG90CmBgYAoKIyMgZ2VvbV9wb2ludCgpIGZ1bmN0aW9uCkl0J3MgZWFzeSB0byBhZGQgZ2VvbWV0cnkgbGF5ZXIgdG8gdGhlIGJhc2UgY28tb3JkaW5hdGVcCkxldCdzIEFERCBhIGxheWVyIG9mIGRhdGEgcG9pbnRzIHVzaW5nICoqZ2VvbV9wb2ludCgpKiogZnVuY3Rpb24uIFwKCkFuZCBZZXMsIHlvdSBjYW4gQUREIGEgbGF5ZXIgYnkgdXNpbmcgdGhlICsgb3BlcmF0b3IKV2UgdXNlICoqZ2VvbV9wb2ludCgpKiogZnVuY3Rpb24gdGhhdCByZXF1aXJlZCB4IGFuZCB5IHZhbHVlIGZvciBlYWNoIHBvaW50LgpJbiAyRCBjby1vcmRpbmF0ZSwgYSBwb2ludCBpcyBkZXNjcmliZWQgYnkgaXRzIHggYW5kIHkgdmFsdWUuCgpXZSBuZWVkIHRvIHByb3ZpZGUgYSBtYXBwaW5nIHRoYXQgc3BlY2lmaWVzIHRoZSBkYXRhIGNvbHVtbnMnIG5hbWUgdG8gbWFwIHRvIGEgcG9pbnQncyB0aGUgeCBhbmQgeSB2YWx1ZQoKVGhhdCBtYXBwaW5nIGlzIGRlZmluZWQgYnkgYW4gYWVzdGhldGljcyBmdW5jdGlvblwKKiphZXMoKSoqCgpTY2F0dGVycGxvdCBpcyB1c2VmdWwgdG8gZXhwbG9yZSB0aGUgcmVsYXRpb24gb2YgdHdvIHZhcmlhYmxlcy4KCmBgYHtyfQpjYXJzICU+JSBnZ3Bsb3QoKSArCiAgZ2VvbV9wb2ludChtYXBwaW5nID0gYWVzKHg9c3BlZWQsIHk9ZGlzdCkpCmBgYAoKIyMgVXNlIGdlb21fbGluZSgpIHRvIHJlcGxhY2UgZ2VvbV9wb2ludCgpCmdlb21fcG9pbnQoKSBhbmQgZ2VvbV9saW5lKCkgcmVxdWlyZSB2ZXJ5IHNpbWlsYXIgcGFyYW1ldGVycy5cCmdlb21fbGluZSgpIGlzIHNpbXBseSBhbiBlbmhhbmNlZCB2aXN1YWxpemF0aW9uIHRoYXQgYXV0b21hdGljYWxseSBjb25uZWN0IGFsbCB0aGUgcG9pbnRzCgpgYGB7cn0KIyBqdXN0IGNoYW5nZSBnZW9tX3BvaW50IHRvIGdlb21fbGluZSB3aXRob3V0IGNoYW5nZSBhbnl0aGluZyBlbHNlCmNhcnMgJT4lIGdncGxvdCgpICsKICBnZW9tX2xpbmUobWFwcGluZyA9IGFlcyh4PXNwZWVkLCB5PWRpc3QpKSAKYGBgCgoKIyMgVXNlIGdlb21fc21vdGgoKSB0byBwcm9qZWN0IGEgc21vb3RoIGxpbmUKYWdhaW4gZ2VvbV9zbW9vdGgoKSBhbmQgZ2VvbV9wb2ludCgpIHJlcXVpcmUgdmVyeSBzaW1pbGFyIHBhcmFtZXRlcnMuXApnZW9tX3Ntb290aCgpIHNtb290aHMgb3V0IHRoZSBsaW5lIHByb2dyZXNzaW9uCgpgYGB7cn0KIyBqdXN0IGNoYW5nZSBnZW9tX3BvaW50IHRvIGdlb21fbGluZSB3aXRob3V0IGNoYW5nZSBhbnl0aGluZyBlbHNlCmNhcnMgJT4lIGdncGxvdCgpICsKICBnZW9tX3Ntb290aChtYXBwaW5nID0gYWVzKHg9c3BlZWQsIHk9ZGlzdCkpIApgYGAKIyMgQWRkaW5nIE11bHRpcGxlIExheWVycwpgYGB7cn0KIyBqdXN0IGNoYW5nZSBnZW9tX3BvaW50IHRvIGdlb21fbGluZSB3aXRob3V0IGNoYW5nZSBhbnl0aGluZyBlbHNlCmNhcnMgJT4lIGdncGxvdCgpICsKICBnZW9tX3BvaW50KG1hcHBpbmcgPSBhZXMoeD1zcGVlZCwgeT1kaXN0KSkgKwogIGdlb21fc21vb3RoKG1hcHBpbmcgPSBhZXMoeD1zcGVlZCwgeT1kaXN0KSkgCmBgYAoKIyMgQWRkaW5nIEFlc3RoZXRpY3MgdG8geW91ciBQbG90cwpVbi1jb21tZW50IHRoZSBleHRyYSBwYXJhbWV0ZXJzIHRvIGFkZCBtb3JlIGFlc3RoZXRpY3MgdG8geW91ciBwbG90CmBgYHtyfQpjYXJzICU+JSBnZ3Bsb3QoKSArCiAgZ2VvbV9wb2ludChtYXBwaW5nID0gYWVzKHg9c3BlZWQsIHk9ZGlzdCksCiAgICAgICAgICAgICBjb2xvciA9ICJvcmFuZ2UiLCAjIHRoZSBjb2xvciBvZiBkYXRhIHBvaW50cwogICAgICAgICAgICAgIyBzaXplID0gMywgIyB0aGUgc2l6ZSBvZiBkYXRhIHBvaW50CiAgICAgICAgICAgICAjIGFscGhhID0gMC41LCAjIHRoZSB0cmFuc3BhcmVuY3kgb2YgZGF0YSBwb2ludHMsIG1pbj0wLCBtYXg9MQogICAgICAgICAgICAgIyBzaGFwZSA9IDAsICMgdGhlIHNoYXBlIG9mIGRhdGEgcG9pbnQKICAgICAgICAgICAgICkKYGBgCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCiMgUExPVCBXSVRIIE9VUiBPV04gREFUQQoKIyMgTG9hZGluZyBEYXRhOiBhbGxvd2FuY2UgJiBncmFkdWF0ZXMKYGBge3IgcmVhZGluZyBkYXRhIGZpbGVzfQphbGxvd2FuY2UgPSByZWFkX2NzdigiLi9kYXRhL2FsbG93YW5jZS5jc3YiKQpwcmludChhbGxvd2FuY2UpCmBgYAoKCiMjIEFsbG93YW5jZSBEYXRhIFNldCBpbiBTaW1wbGUgU2NhdHRlcnBsb3QKYGBge3IgQWxsb3dhbmNlIFNjYXR0ZXJwbG90fQphbGxvd2FuY2UgJT4lIAogIGdncGxvdCgpICsgCiAgZ2VvbV9wb2ludCgKICAgIG1hcHBpbmc9YWVzKHg9QXNzZXNzbWVudF9ZZWFyLCB5PUJhc2ljKSwKICAgIGNvbG9yID0gIm9yYW5nZSIsCiAgICBzaXplID0gMwogICAgKSAKYGBgCgoKIyMgQ29udGludW91cyBWYWx1ZXMgdnMuIERpc2NyZXRlIFZhbHVlcwpDb250aW51b3VzIHZhbHVlcyByZWZlciB0byBudW1iZXJzIHZhbHVlIHRoYXQgaGFzIHdpZGUgcmFuZ2UuIEUuZy4gc2FsYXJ5LCBoZWlnaHQKRGlzY3JldGUgdmFsdWVzIHJlZmVyIHRvIGEgbGltaXRlZCBudW1iZXIgb2YgdmFsaWQgdmFsdWVzLiAgSXQgY2FuIGJlIHN0cmluZy4gSXQgY2FuIGJlIGEgZmV3IGRpc3RpbmN0IG51bWJlcnMuCgpXaGVuIHlvdSBwcm9kdWNlIHBsb3RzLCBwYXkgYXR0ZW50aW9uIHRvIHdoYXQgdHlwZSBvZiB2YWx1ZSBhcmUgcmVxdWlyZWQgYnkgdGhlIGdlb21zLgoKSW4gbWFueSBjYXNlcywgeW91IHdpbGwgbmVlZCB0byBjb252ZXJ0IHRoZSBkYXRhIGZpcnN0LgoqKm11dGF0ZSgpKiogZnVuY3Rpb24gYXJlIHF1aXRlIG9mdGVuIHVzZWQgZm9yIHRoYXQuCgpleGFtcGxlOgpgYGB7cn0KYWxsb3dhbmNlID0gYWxsb3dhbmNlICU+JSAKICBtdXRhdGUoQXNzZXNzbWVudF9ZZWFyID0gYXMubnVtZXJpYyhzdWJzdHIoQXNzZXNzbWVudF9ZZWFyLCAxICw0KSkpIApgYGAKCgojIyBTaW1wbGUgTGluZSBQbG90CmBgYHtyIEFsbG93YW5jZSBMaW5lIEdyYXBofQoKIyBUaGUgZm9sbG93aW5nIHN0YXRlbWVudCBXT04nVCBnZW5lcmF0ZSBhIHBsb3QKYWxsb3dhbmNlICU+JSBnZ3Bsb3QoKSArCiAgZ2VvbV9saW5lKG1hcHBpbmcgPSBhZXMoeD1Bc3Nlc3NtZW50X1llYXIsIHk9QmFzaWMpKQoKIyBGb3IgbGluZSBncmFwaHMsIHRoZSBkYXRhIHBvaW50cyBtdXN0IGJlIGdyb3VwZWQgc28gdGhhdCBpdCBrbm93cyB3aGljaCBwb2ludHMgdG8gY29ubmVjdC4gCiMgSW4gdGhpcyBjYXNlLCBhbGwgcG9pbnRzIHNob3VsZCBiZSBjb25uZWN0ZWQsIHNvIGdyb3VwPTEuIAojIFdoZW4gbW9yZSB2YXJpYWJsZXMgYXJlIHVzZWQgYW5kIG11bHRpcGxlIGxpbmVzIGFyZSBkcmF3biwgdGhlIGdyb3VwaW5nIGZvciBsaW5lcyBpcyB1c3VhbGx5IGRvbmUgYnkgdmFyaWFibGUuCmFsbG93YW5jZSAlPiUgZ2dwbG90KCkgKwogIGdlb21fbGluZShtYXBwaW5nID0gYWVzKHg9QXNzZXNzbWVudF9ZZWFyLCB5PUJhc2ljLCBncm91cD0xLCBjb2xvcj0iT3JhbmdlIikpCmBgYAoKIyMgQWRkaW5nIE11bHRpcGxlIExheWVycyBvZiBHZW9tZXRyeQpgYGB7cn0KYWxsb3dhbmNlICU+JSBnZ3Bsb3QoKSArCiAgZ2VvbV9saW5lKG1hcHBpbmcgPSBhZXMoeD1Bc3Nlc3NtZW50X1llYXIsIHk9QmFzaWMsIGdyb3VwPTEsIGNvbG9yPSJPcmFuZ2UiKSkgKwogIGdlb21fcG9pbnQobWFwcGluZyA9IGFlcyh4PUFzc2Vzc21lbnRfWWVhciwgeT1CYXNpYywgZ3JvdXA9MSwgY29sb3I9Ik9yYW5nZSIpKQoKIyBBcyBib3RoIGdlb20gdXNlIHRoZSBzYW1lIGRhdGEgbWFwcGluZywgdGhlIGFib3ZlIHN0YXRlbWVudHMgY2FuIGJlIHNpbXBsaWZpZWQgYXMKYWxsb3dhbmNlICU+JSBnZ3Bsb3QoYWVzKHg9QXNzZXNzbWVudF9ZZWFyLCB5PUJhc2ljLCBncm91cD0xLCBjb2xvcj0iT3JhbmdlIikpICsKICBnZW9tX2xpbmUoKSArCiAgZ2VvbV9wb2ludChzaXplPTUpCmBgYAoKIyMgVXNlIGdlb21fc21vb3RoKCkgdG8gc21vb3RoIG91dCB0aGUgbGluZQpgYGB7cn0KYWxsb3dhbmNlICU+JSBnZ3Bsb3QoYWVzKHg9QXNzZXNzbWVudF9ZZWFyLCB5PUJhc2ljLCBncm91cD0xLCBjb2xvcj0iT3JhbmdlIikpICsKICBnZW9tX3Ntb290aCgpICsKICBnZW9tX3BvaW50KHNpemU9NSkKYGBgCgoKCiMjIFNhdmUgYSBQbG90OiBnZ3NhdmUoKQpgYGB7cn0KbXkuZmlyc3QucGxvdCA9IGFsbG93YW5jZSAlPiUgCiAgZ2dwbG90KCkgKyAKICBnZW9tX3BvaW50KAogICAgbWFwcGluZz1hZXMoeD1Bc3Nlc3NtZW50X1llYXIsIHk9QmFzaWMpLAogICAgY29sb3IgPSAib3JhbmdlIiwKICAgIHNpemUgPSAzLAogICAgKSAKCnByaW50KG15LmZpcnN0LnBsb3QpCgpnZ3NhdmUoIi4vb3V0cHV0L215X2ZpcnN0X3Bsb3QucG5nIikgIyBkZWZhdWx0IGltYWdlIHNpemUKZ2dzYXZlKCIuL291dHB1dC9teV9maXJzdF9wbG90X2xhcmdlLnBuZyIsIHdpZHRoPTQwMDAsIGhlaWdodD0yMDAwLCB1bml0PSJweCIpCgpgYGAKCiMjIEJhciBDaGFydCB3aXRoIGdlb21fY29sKCkKCmBgYHtyfQphbGxvd2FuY2UgJT4lIAogIGdncGxvdCgpICsKICBnZW9tX2NvbChtYXBwaW5nPWFlcyh4PUFzc2Vzc21lbnRfWWVhciwgeT1CYXNpYyksCiAgICAgICAgICAgZmlsbD0idG9tYXRvIikgCmBgYAoKCgoKIyMgZ2VvbV9iYXIoKQpnZW9tX2JhcigpIGlzIHVzZWQgZm9yIGNvdW50aW5nIHRoZSBmcmVxdWVuY3kgb2YgZWFjaCBvY2N1cnJlbmNlIG9mIG9ic2VydmVkIHZhbHVlLgpJdCdzIHVzdWFsbHkgZm9yIGNvdW50aW5nIGEgbGltaXQgc2V0IG9mIHZhbHVlCgpgYGB7cn0KYWxsb3dhbmNlICU+JSAKICBnZ3Bsb3QoKSArCiAgZ2VvbV9iYXIobWFwcGluZz1hZXMoeD1CYXNpYykpICAKYGBgCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCiMgQ0hBTExFTkdFCiMjIE11bHRpcGxlIExheWVycyBvZiBMaW5lcwphZGQgbGluZSBwbG90IGZvciBjb2x1bW4gb2YgQ2hpbGQKaW4gdGhlIHNhbWUgcGxvdCwgYWRkIGFub3RoZXIgbGluZSBwbG90IGZvciBEZXBlbmRlbnRfUGFyZW50XzYwCmBgYHtyfQphbGxvd2FuY2UgJT4lIGdncGxvdCgpICsKICBnZW9tX2xpbmUobWFwcGluZyA9IGFlcyh4PUFzc2Vzc21lbnRfWWVhciwgeT1DaGlsZCwgZ3JvdXA9MSksIGNvbG9yPSJPcmFuZ2UiKSArIAogIGdlb21fbGluZShtYXBwaW5nID0gYWVzKHg9QXNzZXNzbWVudF9ZZWFyLCB5PURlcGVuZGVudF9QYXJlbnRfNjAsIGdyb3VwPTEpLCBjb2xvcj0iQmx1ZSIpIApgYGAKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKIyBXT1JLIFdJVEggTU9SRSBDT01QTEVYIERBVEEKCiMjIExvYWRpbmcgRGF0YTogZ3JhZHVhdGVzLmNzdgpgYGB7ciByZWFkaW5nIGNvbXBsZXggZGF0YX0KZ3JhZHVhdGVzID0gcmVhZF9jc3YoIi4vZGF0YS9ncmFkdWF0ZXMuY3N2IikKcHJpbnQoZ3JhZHVhdGVzKQpgYGAKCiMjIFNpbXBsZSBTY2F0dGVycGxvdApMZXQncyBleHBsb3JlIHRoZSBkYXRhIHdpdGggc29tZSBzaW1wbGUgZ2dwbG90IHBsb3QuIApPdmVyYWxsIHRoZXkgYXJlIG5vdCB2ZXJ5IHVzZWZ1bC4gIEp1c3Qgc29tZSBxdWljayBleHBsb3JhdGlvbi4KCmBgYHtyfQpnZ3Bsb3QoZGF0YT1ncmFkdWF0ZXMpICsKICBnZW9tX3BvaW50KG1hcHBpbmc9YWVzKHg9QWNhZGVtaWNZZWFyLCB5PUhlYWRjb3VudCkpCgpnZ3Bsb3QoZGF0YT1ncmFkdWF0ZXMpICsKICBnZW9tX3BvaW50KG1hcHBpbmc9YWVzKHg9QWNhZGVtaWNZZWFyLCB5PUhlYWRjb3VudCwgc2hhcGU9U2V4KSAjIHVzZSBzaGFwZSB0byBkaWZmZXJlbnRpYXRlIGdyb3VwcwogICAgICAgICAgICAgKQoKZ2dwbG90KGRhdGE9Z3JhZHVhdGVzKSArCiAgZ2VvbV9wb2ludChtYXBwaW5nPWFlcyh4PUFjYWRlbWljWWVhciwgeT1IZWFkY291bnQsIGNvbG9yPVNleCkgIyB1c2UgY29sb3IgdG8gZGlmZmVyZW50aWF0ZSBncm91cHMKICAgICAgICAgICAgICkKYGBgCgojIyBVc2UgZmlsdGVyKCkgdG8gRXh0cmFjdCBSZXF1aXJlZCBSb3dzCmBgYHtyIHVzZSBmaWx0ZXIoKX0KZ3JhZHVhdGVzICU+JSAKZmlsdGVyKExldmVsT2ZTdHVkeT09IlVuZGVyZ3JhZHVhdGUiLCBQcm9ncmFtbWVDYXRlZ29yeT09IkJ1c2luZXNzIGFuZCBNYW5hZ2VtZW50IikgJT4lCmdncGxvdCgpICsKICBnZW9tX3BvaW50KG1hcHBpbmc9YWVzKHg9QWNhZGVtaWNZZWFyLCB5PUhlYWRjb3VudCwgY29sb3I9U2V4KQopCmBgYAoKCiMjIFVzZSBMaW5lIFBsb3QgVG8gRXhwbG9yZSB0aGUgVHJlbmRpbmcgClVzZSBsaW5lIHBsb3QgdG8gZXhwbG9yZSB0aGUgdHJlbmRpbmcgb2YgIkJ1c2luZXNzIGFuZCBNYW5hZ2VtZW50IiBzdHVkZW50IGhlYWRjb3VudCB0cmVuZGluZwoKCmBgYHtyfQpsaWJyYXJ5KG1hZ3JpdHRyKQpncmFkdWF0ZXMgJTw+JQogIG11dGF0ZShBY2FkZW1pY1llYXI9YXMuZmFjdG9yKEFjYWRlbWljWWVhciksCiAgICAgICAgIFNleD1hcy5mYWN0b3IoU2V4KQogICAgICAgICApICMgY29udmVydCB0aGUgQWNhZGVtaWNZZWFyIGFuZCBTZXggdG8gZmFjdG9yIHR5cGUKCmdyYWR1YXRlcyAlPiUgCmZpbHRlcihMZXZlbE9mU3R1ZHk9PSJVbmRlcmdyYWR1YXRlIiwgUHJvZ3JhbW1lQ2F0ZWdvcnk9PSJCdXNpbmVzcyBhbmQgTWFuYWdlbWVudCIpICU+JQpnZ3Bsb3QoKSArCiAgZ2VvbV9saW5lKAogICAgbWFwcGluZz1hZXMoeD1BY2FkZW1pY1llYXIsIAogICAgICAgICAgICAgICAgICAgICAgICAgeT1IZWFkY291bnQsCiAgICAgICAgICAgICAgICAgICAgICAgICBncm91cD1TZXgsIAogICAgICAgICAgICAgICAgICAgICAgICAgY29sb3I9U2V4CiAgICAgICAgICAgICAgICAgICAgICAgICApCiAgICAgICAgICAgICApCgpgYGAKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKIyBDSEFMTEVOR0UKIyMgQ29tcGFyaXNvbiB3aXRoIExpbmUgUGxvdHMKVXNlIGxpbmUgcGxvdHMgdG8gY29tcGFyZSBmZW1hbGUgdW5kZXJncmFkdWF0ZSBzdHVkZW50cyBoZWFkY291bnQgdHJlbmRpbmcgaW4gUHJvZ3JhbW1lQ2F0ZWdvcnkgb2YgIkJ1c2luZXNzIGFuZCBNYW5hZ2VtZW50IiBhbmQgIkVuZ2luZWVyaW5nIGFuZCBUZWNobm9sb2d5IgpVc2UgZmlsdGVyKCkgdG8gZXh0cmFjdCByZXF1aXJlZCByZWNvcmQKWW91IGNhbiB1c2UgbXVsdGlwbGUgZmlsdGVyKCkgY2FsbApVc2UgJiwgfCBvciBtdWx0aXBsZSBjb25kaXRpb25zCgoKYGBge3IgUHJldmlld2luZyBQcm9ncmFtQ2F0ZWdvcnl9CmdyYWR1YXRlcyAlPiUgCiAgLiRQcm9ncmFtbWVDYXRlZ29yeSAlPiUgCiAgdW5pcXVlKCkgIyBkaXNwbGF5IHRoZSB1bmlxdWUgbmFtZXMgb2YgUHJvZ3JhbW1lQ2F0ZWdvcnkKCmdyYWR1YXRlcyAlPiUgCiAgZmlsdGVyKExldmVsT2ZTdHVkeT09IlVuZGVyZ3JhZHVhdGUiLCBTZXg9PSJGIikgJT4lCiAgZmlsdGVyKFByb2dyYW1tZUNhdGVnb3J5PT0iQnVzaW5lc3MgYW5kIE1hbmFnZW1lbnQiIHwgUHJvZ3JhbW1lQ2F0ZWdvcnk9PSJFbmdpbmVlcmluZyBhbmQgVGVjaG5vbG9neSIpICU+JSAKICBwcmludCgpICMgVGVzdCBleHRyYWN0aW5nIGFuZCBwcmludGluZyB0aGUgcmVxdWlyZWQgcmVjb3Jkcy4KYGBgCgoKYGBge3IgQnVzaW5lc3MgYW5kIE1hbmFnZW1lbnQgdnMuIEVuZ2luZWVyaW5nIGFuZCBUZWNobm9sb2d5fQpncmFkdWF0ZXMgJT4lIAogIGZpbHRlcihMZXZlbE9mU3R1ZHk9PSJVbmRlcmdyYWR1YXRlIiwgU2V4PT0iRiIpICU+JQogIGZpbHRlcihQcm9ncmFtbWVDYXRlZ29yeT09IkJ1c2luZXNzIGFuZCBNYW5hZ2VtZW50IiB8IFByb2dyYW1tZUNhdGVnb3J5PT0iRW5naW5lZXJpbmcgYW5kIFRlY2hub2xvZ3kiKSAlPiUgCiAgZ2dwbG90KAogICAgYWVzKHg9QWNhZGVtaWNZZWFyLCAKICAgICAgICAgICAgIHk9SGVhZGNvdW50LAogICAgICAgICAgICAgZ3JvdXA9UHJvZ3JhbW1lQ2F0ZWdvcnksIAogICAgICAgICAgICAgY29sb3I9UHJvZ3JhbW1lQ2F0ZWdvcnkKICAgICAgICAgICAgICkKICAgICkgKwogICAgZ2VvbV9saW5lKCkgKwogICAgZ2VvbV9wb2ludCgpIAogIApgYGAKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKCiMgQ0hBTExFTkdFOiBsaW5lIHBsb3QgZm9yIGhpYm9yX2ZpeGluZ18xbQpgYGB7cn0KbGlicmFyeShqc29ubGl0ZSkgIyBsb2FkIHBhY2thZ2UKaGttYS5pbnRlcmJhbmsudXJsID0gImh0dHBzOi8vYXBpLmhrbWEuZ292LmhrL3B1YmxpYy9tYXJrZXQtZGF0YS1hbmQtc3RhdGlzdGljcy9kYWlseS1tb25ldGFyeS1zdGF0aXN0aWNzL2RhaWx5LWZpZ3VyZXMtaW50ZXJiYW5rLWxpcXVpZGl0eSIKaW50ZXJiYW5rLmxpcXVpZGl0eSA9IGZyb21KU09OKGhrbWEuaW50ZXJiYW5rLnVybCkKIyB0aGUgYWJvdmUgcmV0cmlldmFsIHdpbGwgdGFrZSBhIHdoaWxlLiAgVGhlIHNlcnZlciByZXNwb25zZSBpcyBzbG93LgpzdW1tYXJ5KGludGVyYmFuay5saXF1aWRpdHkpCnN0cihpbnRlcmJhbmsubGlxdWlkaXR5KQppbnRlcmJhbmsubGlxdWlkaXR5JHJlc3VsdApzdHIoaW50ZXJiYW5rLmxpcXVpZGl0eSRyZXN1bHQpCmludGVyYmFuay5yZWNvcmRzID0gaW50ZXJiYW5rLmxpcXVpZGl0eSRyZXN1bHQkcmVjb3JkcyAlPiUgYXNfdGliYmxlKCkKaW50ZXJiYW5rLnJlY29yZHMKCmludGVyYmFuay5yZWNvcmRzICU+JSAKZ2dwbG90KCkgKwogIGdlb21fbGluZSgKICAgIG1hcHBpbmc9YWVzKHg9ZW5kX29mX2RhdGUsIHk9aGlib3JfZml4aW5nXzFtLCBncm91cD0xKSwKICAgIGNvbG9yPSJvcmFuZ2UiCiAgICAgICAgICAgICApCgpgYGAKCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCiMgR1JPVVBJTkcgQU5EIEFHR1JFR0FUSU9OCgojIyBVc2luZyBncm91cF9ieSgpIGFuZCBzdW1tYXJpc2UoKSAKYGBge3J9CmdyYWR1YXRlcyAlPiUgZ3JvdXBfYnkoQWNhZGVtaWNZZWFyLCBMZXZlbE9mU3R1ZHkpICU+JSAKICBzdW1tYXJpc2UoVG90YWxIZWFkY291bnQgPSBzdW0oSGVhZGNvdW50KSkgCgpncmFkdWF0ZXMgJT4lIGdyb3VwX2J5KEFjYWRlbWljWWVhciwgTGV2ZWxPZlN0dWR5KSAlPiUgCiAgc3VtbWFyaXNlKFRvdGFsSGVhZGNvdW50ID0gc3VtKEhlYWRjb3VudCkpICU+JSAKICBnZ3Bsb3QoCiAgICBhZXMoeD1BY2FkZW1pY1llYXIsIAogICAgICAgICAgICAgeT1Ub3RhbEhlYWRjb3VudCwKICAgICAgICAgICAgIGdyb3VwPUxldmVsT2ZTdHVkeSwgCiAgICAgICAgICAgICBjb2xvcj1MZXZlbE9mU3R1ZHkKICAgICAgICAgICAgICkKICAgICkgKwogICAgZ2VvbV9saW5lKCkgKwogICAgZ2VvbV9wb2ludCgpIAogIApgYGAKCiMjIFVzZSBvZiBmaWx0ZXIoKQpVc2UgZmlsdGVyKCkgdG8ga2VlcCBvbmx5ICJUYXVnaHQgUG9zdGdyYWR1YXRlIiBSZWNvcmRzCgpUaGlzIHBsb3QgaXMgbm90IHZlcnkgdXNlZnVsIHdpdGhvdXQgcHJldmlvdXNseSBhcHBseWluZyBmaWx0ZXIoKSBhbmQgZ3JvdXBfYnkoKSBhbmQgc3VtbWFyaXNlKCkKCmBgYHtyfQpncmFkdWF0ZXMgJT4lIAogIGZpbHRlcihMZXZlbE9mU3R1ZHk9PSJUYXVnaHQgUG9zdGdyYWR1YXRlIikgJT4lIAogIGdncGxvdCgpICsKICAgIGdlb21fbGluZShtYXBwaW5nPWFlcyh4PUFjYWRlbWljWWVhcix5PUhlYWRjb3VudCwgZ3JvdXA9UHJvZ3JhbW1lQ2F0ZWdvcnksIGNvbG9yPVByb2dyYW1tZUNhdGVnb3J5KSkKYGBgCgoKIyMgZmlsdGVyKCkgKyBncm91cF9ieSgpICsgc3VtbWFyaXNlKCkKVXNlIGZpbHRlcigpIHRvIGV4dHJhY3QgcmVxdWlyZWQgcm93cwpVc2UgZ3JvdXBfYnkoKSBhbmQgc3VtbWFyaXNlKCkgdG8gZ3JvdXAgYW5kIGFnZ3JlYXRlIHRvdGFsIGhlYWRjb3V0IGZvciBib3RoIG1hbGUgYW5kIGZlbWFsZQpgYGB7ciBnZ3Bsb3QgbGluZX0KCmdyYWR1YXRlcyAlPiUgCiAgZmlsdGVyKExldmVsT2ZTdHVkeT09IlRhdWdodCBQb3N0Z3JhZHVhdGUiKSAlPiUgCiAgZ3JvdXBfYnkoQWNhZGVtaWNZZWFyLCBQcm9ncmFtbWVDYXRlZ29yeSkgJT4lIAogIHN1bW1hcmlzZShUb3RhbEhlYWRjb3VudCA9IHN1bShIZWFkY291bnQpKSAlPiUgCiAgZ2dwbG90KCkgKwogICAgZ2VvbV9saW5lKG1hcHBpbmc9YWVzKHg9QWNhZGVtaWNZZWFyLHk9VG90YWxIZWFkY291bnQsIGdyb3VwPVByb2dyYW1tZUNhdGVnb3J5LCBjb2xvcj1Qcm9ncmFtbWVDYXRlZ29yeSkpCgojIEZvbGxvd2luZyBpcyB0aGUgc2FtZSBjaGFydCBmb3IgInVuZGVyZ3JhZHVhdGUiIAojIGdyYWR1YXRlcyAlPiUKIyAgIGZpbHRlcihMZXZlbE9mU3R1ZHk9PSJVbmRlcmdyYWR1YXRlIikgJT4lCiMgICBncm91cF9ieShBY2FkZW1pY1llYXIsIFByb2dyYW1tZUNhdGVnb3J5KSAlPiUKIyAgIHN1bW1hcmlzZShUb3RhbEhlYWRjb3VudCA9IHN1bShIZWFkY291bnQpKSAlPiUKIyAgIGdncGxvdCgpICsKIyAgICAgZ2VvbV9saW5lKG1hcHBpbmc9YWVzKHg9QWNhZGVtaWNZZWFyLHk9VG90YWxIZWFkY291bnQsIGdyb3VwPVByb2dyYW1tZUNhdGVnb3J5LCBjb2xvcj1Qcm9ncmFtbWVDYXRlZ29yeSkpCiAgICAKYGBgCgoKCiMjIGdlb21fY29sKCkgZnVuY3Rpb24KCmBgYHtyfQpMZXZlbE9mU3R1ZHkgPSBncmFkdWF0ZXMgJT4lIC4kTGV2ZWxPZlN0dWR5ICU+JSB1bmlxdWUoKQpQcm9ncmFtbWVDYXRlZ29yeSA9IGdyYWR1YXRlcyAlPiUgLiRQcm9ncmFtbWVDYXRlZ29yeSAlPiUgdW5pcXVlKCkgCnByaW50KExldmVsT2ZTdHVkeSkKcHJpbnQoUHJvZ3JhbW1lQ2F0ZWdvcnkpCiAgCmdyYWR1YXRlcyAlPiUgCmZpbHRlcihQcm9ncmFtbWVDYXRlZ29yeT09IkJ1c2luZXNzIGFuZCBNYW5hZ2VtZW50IikgJT4lIApnZ3Bsb3QoKSArCiAgZ2VvbV9jb2wobWFwcGluZz1hZXMoeD1BY2FkZW1pY1llYXIsIHk9SGVhZGNvdW50LCBmaWxsPUxldmVsT2ZTdHVkeSkpCgpncmFkdWF0ZXMgJT4lIApmaWx0ZXIoUHJvZ3JhbW1lQ2F0ZWdvcnk9PSJFbmdpbmVlcmluZyBhbmQgVGVjaG5vbG9neSIpICU+JSAKZ2dwbG90KCkgKwogIGdlb21fY29sKG1hcHBpbmc9YWVzKHg9QWNhZGVtaWNZZWFyLCB5PUhlYWRjb3VudCwgZmlsbD1MZXZlbE9mU3R1ZHkpKQoKYGBgCgojIyBNb3JlIEFnZ3JlZ2F0aW9uIEZ1bmN0aW9ucwpDZW50ZXI6IG1lYW4oKSwgbWVkaWFuKCkKU3ByZWFkOiBzZCgpLCBJUVIoKSwgbWFkKCkKUmFuZ2U6IG1pbigpLCBtYXgoKSwgcXVhbnRpbGUoKQpQb3NpdGlvbjogZmlyc3QoKSwgbGFzdCgpLCBudGgoKSwKQ291bnQ6IG4oKSwgbl9kaXN0aW5jdCgpCkxvZ2ljYWw6IGFueSgpLCBhbGwoKQoKTW9yZSBpbmZvcm1hdGlvbiBhdApbc3VtbWFyaXNlKCkgZnVuY3Rpb25dKGh0dHBzOi8vZHBseXIudGlkeXZlcnNlLm9yZy9yZWZlcmVuY2Uvc3VtbWFyaXNlLmh0bWwpCgoKIyMgZ2VvbV9iYXIoKSBmdW5jdGlvbgpiYXIgY2hhcnQgZ2l2ZSB0aGUgY291bnRpbmcgZnJlcXVlbmN5IChudW1iZXIgb2YgcmVjb3JkIGluIHRoZSBkYXRhIHNldCkKYGBge3J9CgpncmFkdWF0ZXMgJT4lIApnZ3Bsb3QoKSArCiAgZ2VvbV9iYXIobWFwcGluZz1hZXMoeD1BY2FkZW1pY1llYXIpKSAjIHlvdSBvbmx5IG5lZWQgdG8gcHJvdmlkZSB0aGUgeCBheGlzCmBgYAoKIyMgYm94IHBsb3QKVGhlIGJveHBsb3QgY29tcGFjdGx5IGRpc3BsYXlzIHRoZSBkaXN0cmlidXRpb24gb2YgYSBjb250aW51b3VzIHZhcmlhYmxlLlxuCkl0IHZpc3VhbGlzZXMgZml2ZSBzdW1tYXJ5IHN0YXRpc3RpY3MgKHRoZSBtZWRpYW4sIHR3byBoaW5nZXMgYW5kIHR3byB3aGlza2VycyksIGFuZCBhbGwgIm91dGx5aW5nIiBwb2ludHMgaW5kaXZpZHVhbGx5LgoKYGBge3J9CmdyYWR1YXRlcyAlPiUgCmdncGxvdCgpICsKICBnZW9tX3BvaW50KG1hcHBpbmc9YWVzKHg9U2V4LCB5PUhlYWRjb3VudCkpCgpncmFkdWF0ZXMgJT4lIApnZ3Bsb3QoKSArCiAgZ2VvbV9ib3hwbG90KG1hcHBpbmc9YWVzKHg9TGV2ZWxPZlN0dWR5LCB5PUhlYWRjb3VudCkpCmBgYAoKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKIyBNQUtFIElUIFBSRVRUWQpVc2Ugb2YgdGl0bGUsIGxhYmVsLCBiYWNrZ3JvdW5kIGNvbG9yIGFuZCB0aGVtZXMKCmBgYHtyfQojIGluIHRoaXMgZXhhbXBsZSB3ZSBzYXZlIHRoZSBwbG90IHRvIGEgdmFyaWFibGUgbmFtZSAnbGV2ZWwuYmFyLnBsb3QnIHNvIHRoYXQgd2UgY2FuIHVzZSBpdCBhZ2FpbiBhbmQgYWdhaW4uCmxldmVsLmJhci5wbG90ID0gZ3JhZHVhdGVzICU+JSAKZmlsdGVyKFByb2dyYW1tZUNhdGVnb3J5PT0iRW5naW5lZXJpbmcgYW5kIFRlY2hub2xvZ3kiKSAlPiUgCmdncGxvdCgpICsKICBnZW9tX2NvbChtYXBwaW5nPWFlcyh4PUFjYWRlbWljWWVhciwgeT1IZWFkY291bnQsIGZpbGw9TGV2ZWxPZlN0dWR5KSkKCiMgVG8gc2hvdyB0aGUgcGxvdCwganVzdCB1c2UgcHJpbnQoKSBmdW5jdGlvbiB3aXRoIHRoZSBwcmV2aW91cyBzYXZlZCBwbG90IHZhcmlhYmxlIGFzIHBhcmFtZXRlci4KcHJpbnQobGV2ZWwuYmFyLnBsb3QpCmBgYAoKCiMjIFBsb3QgQmFja2dyb3VuZAoqKmVsZW1lbnRfcmVjdCgpKiogaXMgYSBmdW5jdGlvbiB0byBnZW5lcmF0ZWQgcmVjdGFuZ2xlIGdlb21ldHJ5IGVsZW1lbnQuCllvdSBoYXZlIHRvIHNwZWNpZnkgdGhlICoqZmlsbCoqIHBhcmFtZXRlciBieSBjb2xvciBuYW1lIG9yIGhleCBjb2RlIGNvZGUgYnkgc3RyaW5nCgpQbG90IEJhY2tncm91bmQgcmVmZXJzIHRvIHRoZSBiaWcgYXJlYSBvZiBldmVyeXRoaW5nIHJlbGV2YW50IHRvIHRoZSBwbG90LgoKYGBge3J9CmxldmVsLmJhci5wbG90ICMgZGVmYXVsdCBzdHlsZQoKbGV2ZWwuYmFyLnBsb3QgKwogIHRoZW1lKHBsb3QuYmFja2dyb3VuZCA9IGVsZW1lbnRfcmVjdChmaWxsPSJvcmFuZ2UiKSkgIyBzdHlsaW5nIHRoZSBwbG90IGJhY2tncm91bmQKYGBgCgojIyBQYW5lbCBCYWNrZ3JvdW5kClBhbmVsIGJhY2tncm91bmQgcmVmZXJzIHRvIHRoZSBpbm5lciBhcmVhIG9mIHBsb3QuIEFyZWEgZm9yIHNob3dpbmcgaGVhZGVyLCBheGlzIGxhYmxlIGFuZCBsZWdlbmQgYXJlIE5PVCBpbmNsdWRlZC4KYGBge3J9CmxldmVsLmJhci5wbG90ICMgZGVmYXVsdCBzdHlsZQoKbGV2ZWwuYmFyLnBsb3QgKwogIHRoZW1lKHBhbmVsLmJhY2tncm91bmQgPSBlbGVtZW50X3JlY3QoZmlsbD0ib3JhbmdlIikpICMgc3R5bGluZyB0aGUgcGFuZWwgYmFja2dyb3VuZApgYGAKCiMjIFJlbW92ZSBQbG90IGFuZCBQYW5lbCBCYWNrZ3JvdW5kCkluIHZpc3VhbCBkZXNpZ24sIGNvbG9yIGlzIHZlcnkgcG93ZXJmdWwgdG9vbCB0byBndWlkZSB1c2VycycgYXR0ZW50aW9uLiBCdXQgeW91IGhhdmUgdG8gdXNlIHRoZW0gY2FyZWZ1bGx5LgoKVG9vIG1hbnkgY29sb3JzIHdpbGwgdXN1YWxseSBkbyB0aGUgb3Bwb3NpdGUgLSBjb25mdXNlIHRoZSBhdWRpZW5jZS4KTWluaW1hbCBkZXNpZ24gaXMgdGhlIHJlY2VudCB0cmVuZC4gIEV4cGVjaWFsbHkgdHJ1ZSB3aGVuIG1hbnkgYXJlIHVzaW5nIHNtYWxsIGRldmljZSBsaWtlIG1vYmlsZSBwaG9uZSBmb3IgZGF5LXRvLWRheSBjb21tdW5pY2F0aW9uLgoKSW4gdGhpcyBleGFtcGxlLCB3ZSBhcmUgcmVtb3ZpbmcgYm90aCBwbG90IGFuZCBwYW5lbCBiYWNrZ3JvdW5kIHRvIGFjaGlldmUgYSBjbGVhbiBkZXNpZ24uICBBZnRlciBhbGwsIGJhY2tncm91bmQgaXMgdGhlIG1haW4gZGlzaC4gVmVyeSBvZnRlbiBiYWNrZ3JvdW5kIGNvbG9yIGNhdXNlcyBkaXN0cmFjdGlvbiB0byBncmFwaC4KCmBgYHtyfQpsZXZlbC5iYXIucGxvdCAjIGRlZmF1bHQgc3R5bGUKCmxldmVsLmJhci5wbG90ICsKICB0aGVtZShwYW5lbC5iYWNrZ3JvdW5kID0gZWxlbWVudF9ibGFuaygpKSArICMgc3R5bGluZyB0aGUgcGFuZWwgYmFja2dyb3VuZCB0byBub25lCiAgdGhlbWUocGxvdC5iYWNrZ3JvdW5kID0gZWxlbWVudF9ibGFuaygpKSArICMgc3R5bGluZyB0aGUgcGxvdCBiYWNrZ3JvdW5kIHRvIG5vbmUKICB0aGVtZShwYW5lbC5ncmlkLm1ham9yLnkgPSBlbGVtZW50X2xpbmUoY29sb3I9ImdyZXkiKSkgIyBzdHlsaW5nIHRoZSBncmlkIGxpbmUgZm9yIHktYXhpcwpgYGAKCiMjIENoYW5nZSBMYWJlbCBmb3IgeC95IEF4aXMKYGBge3J9CmxldmVsLmJhci5wbG90ICMgZGVmYXVsdCBzdHlsZQoKbGV2ZWwuYmFyLnBsb3QgKwogIHRoZW1lKHBhbmVsLmJhY2tncm91bmQgPSBlbGVtZW50X2JsYW5rKCkpICsgIyBzdHlsaW5nIHRoZSBwYW5lbCBiYWNrZ3JvdW5kIHRvIG5vbmUKICB0aGVtZShwbG90LmJhY2tncm91bmQgPSBlbGVtZW50X2JsYW5rKCkpICsgIyBzdHlsaW5nIHRoZSBwbG90IGJhY2tncm91bmQgdG8gbm9uZQogIHRoZW1lKHBhbmVsLmdyaWQubWFqb3IueSA9IGVsZW1lbnRfbGluZShjb2xvcj0iZ3JleSIpKSArICMgc3R5bGluZyB0aGUgZ3JpZCBsaW5lIGZvciB5LWF4aXMKICB5bGFiKCJOdW1iZXIgb2YgU3R1ZGVudCIpICsgIyBMYWJlbCBmb3IgWSBheGlzCiAgeGxhYigiWWVhciIpICMgTGFiZWwgZm9yIFggYXhpcwpgYGAKCiMjIENoYW5nZSBGaWxsIENvbG9ycwpgYGB7cn0KbGV2ZWwuYmFyLnBsb3QgIyBkZWZhdWx0IHN0eWxlCgpsZXZlbC5iYXIucGxvdCArCiAgdGhlbWUocGFuZWwuYmFja2dyb3VuZCA9IGVsZW1lbnRfYmxhbmsoKSkgKyAjIHN0eWxpbmcgdGhlIHBhbmVsIGJhY2tncm91bmQgdG8gbm9uZQogIHRoZW1lKHBsb3QuYmFja2dyb3VuZCA9IGVsZW1lbnRfYmxhbmsoKSkgKyAjIHN0eWxpbmcgdGhlIHBsb3QgYmFja2dyb3VuZCB0byBub25lCiAgdGhlbWUocGFuZWwuZ3JpZC5tYWpvci55ID0gZWxlbWVudF9saW5lKGNvbG9yPSJncmV5IikpICsgIyBzdHlsaW5nIHRoZSBncmlkIGxpbmUgZm9yIHktYXhpcwogIHlsYWIoIk51bWJlciBvZiBTdHVkZW50IikgKyAjIExhYmVsIGZvciBZIGF4aXMKICB4bGFiKCJZZWFyIikgKyAjIExhYmVsIGZvciBYIGF4aXMKICBzY2FsZV9maWxsX21hbnVhbCh2YWx1ZXM9YygicHVycGxlIiwgIm9yYW5nZSIsICJibHVlIiwgInRvbWF0byIpKSAjIHVzZSBjKCkgZnVuY3Rpb24gdG8gc3BlY2lmeSBjb2xvciBsaXN0CmBgYAoKIyMgU3R5bGluZyBUaGUgTGVnZW5kcwpgYGB7cn0KbGV2ZWwuYmFyLnBsb3QgIyBkZWZhdWx0IHN0eWxlCgpsZXZlbC5iYXIucGxvdCArCiAgdGhlbWUocGFuZWwuYmFja2dyb3VuZCA9IGVsZW1lbnRfYmxhbmsoKSkgKyAjIHN0eWxpbmcgdGhlIHBhbmVsIGJhY2tncm91bmQgdG8gbm9uZQogIHRoZW1lKHBsb3QuYmFja2dyb3VuZCA9IGVsZW1lbnRfYmxhbmsoKSkgKyAjIHN0eWxpbmcgdGhlIHBsb3QgYmFja2dyb3VuZCB0byBub25lCiAgdGhlbWUocGFuZWwuZ3JpZC5tYWpvci55ID0gZWxlbWVudF9saW5lKGNvbG9yPSJncmV5IikpICsgIyBzdHlsaW5nIHRoZSBncmlkIGxpbmUgZm9yIHktYXhpcwogIHlsYWIoIk51bWJlciBvZiBTdHVkZW50IikgKyAjIExhYmVsIGZvciBZIGF4aXMKICB4bGFiKCJZZWFyIikgKyAjIExhYmVsIGZvciBYIGF4aXMKICB0aGVtZShsZWdlbmQucG9zaXRpb249InRvcCIpICsKICBzY2FsZV9maWxsX21hbnVhbCh2YWx1ZXM9YygicHVycGxlIiwgIm9yYW5nZSIsICJibHVlIiwgInRvbWF0byIpLAogICAgICAgICAgICAgICAgICAgIGd1aWRlID0gZ3VpZGVfbGVnZW5kKHRpdGxlPSJMZXZlbCBvZiBTdHVkeSIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxhYmVsLnBvc2l0aW9uID0gImJvdHRvbSIpCiAgICAgICAgICAgICAgICAgICAgKSAjIG1vdmUgbGVnZW5kIHBvc2l0aW9uIHRvIHRvcCBhbmQgbGFiZWwgcG9zaXRpb24gdG8gYm90dG9tIAogIApgYGAKCiMjIEFkZCBUaXRsZSBhbmQgU3VidGl0bGUKYGBge3J9CmxldmVsLmJhci5wbG90ICMgZGVmYXVsdCBzdHlsZQoKbGV2ZWwuYmFyLnBsb3QgKwogIHRoZW1lKHBhbmVsLmJhY2tncm91bmQgPSBlbGVtZW50X2JsYW5rKCkpICsgIyBzdHlsaW5nIHRoZSBwYW5lbCBiYWNrZ3JvdW5kIHRvIG5vbmUKICB0aGVtZShwbG90LmJhY2tncm91bmQgPSBlbGVtZW50X2JsYW5rKCkpICsgIyBzdHlsaW5nIHRoZSBwbG90IGJhY2tncm91bmQgdG8gbm9uZQogIHRoZW1lKHBhbmVsLmdyaWQubWFqb3IueSA9IGVsZW1lbnRfbGluZShjb2xvcj0iZ3JleSIpKSArICMgc3R5bGluZyB0aGUgZ3JpZCBsaW5lIGZvciB5LWF4aXMKICB5bGFiKCJOdW1iZXIgb2YgU3R1ZGVudCIpICsgIyBMYWJlbCBmb3IgWSBheGlzCiAgeGxhYigiWWVhciIpICsgIyBMYWJlbCBmb3IgWCBheGlzCiAgdGhlbWUobGVnZW5kLnBvc2l0aW9uPSJ0b3AiKSArCiAgc2NhbGVfZmlsbF9tYW51YWwodmFsdWVzPWMoInB1cnBsZSIsICJvcmFuZ2UiLCAiYmx1ZSIsICJ0b21hdG8iKSwKICAgICAgICAgICAgICAgICAgICBndWlkZSA9IGd1aWRlX2xlZ2VuZCh0aXRsZT0iTGV2ZWwgb2YgU3R1ZHkiLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBsYWJlbC5wb3NpdGlvbiA9ICJib3R0b20iKQogICAgICAgICAgICAgICAgICAgICkgKyAjIG1vdmUgbGVnZW5kIHBvc2l0aW9uIHRvIHRvcCBhbmQgbGFiZWwgcG9zaXRpb24gdG8gYm90dG9tIAogIGdndGl0bGUoIkhvbmcgS29uZyBIaWdoZXIgRWR1Y2F0aW9uIFN0dWRlbnQgSGVhZGNvdW50Iiwgc3VidGl0bGU9IjIwMDkgLSAyMDE5IikKYGBgCgojIyBBZGQgQW5ub3RhdGlvbnMgVGV4dHMKQWRkIGV4dHJhIHRleHRzL3NoYXBlIHRvIGVuaGFuY2UgeW91ciB2aXN1YWxpemF0aW9uCmBgYHtyfQpsZXZlbC5iYXIucGxvdCAjIGRlZmF1bHQgc3R5bGUKCmxldmVsLmJhci5wbG90ICsKICB0aGVtZShwYW5lbC5iYWNrZ3JvdW5kID0gZWxlbWVudF9ibGFuaygpKSArICMgc3R5bGluZyB0aGUgcGFuZWwgYmFja2dyb3VuZCB0byBub25lCiAgdGhlbWUocGxvdC5iYWNrZ3JvdW5kID0gZWxlbWVudF9ibGFuaygpKSArICMgc3R5bGluZyB0aGUgcGxvdCBiYWNrZ3JvdW5kIHRvIG5vbmUKICB0aGVtZShwYW5lbC5ncmlkLm1ham9yLnkgPSBlbGVtZW50X2xpbmUoY29sb3I9ImdyZXkiKSkgKyAjIHN0eWxpbmcgdGhlIGdyaWQgbGluZSBmb3IgeS1heGlzCiAgeWxhYigiTnVtYmVyIG9mIFN0dWRlbnQiKSArICMgTGFiZWwgZm9yIFkgYXhpcwogIHhsYWIoIlllYXIiKSArICMgTGFiZWwgZm9yIFggYXhpcwogIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbj0idG9wIikgKwogIHNjYWxlX2ZpbGxfbWFudWFsKHZhbHVlcz1jKCJwdXJwbGUiLCAib3JhbmdlIiwgImJsdWUiLCAidG9tYXRvIiksCiAgICAgICAgICAgICAgICAgICAgZ3VpZGUgPSBndWlkZV9sZWdlbmQodGl0bGU9IkxldmVsIG9mIFN0dWR5IiwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGFiZWwucG9zaXRpb24gPSAiYm90dG9tIikKICAgICAgICAgICAgICAgICAgICApICsgIyBtb3ZlIGxlZ2VuZCBwb3NpdGlvbiB0byB0b3AgYW5kIGxhYmVsIHBvc2l0aW9uIHRvIGJvdHRvbSAKICBnZ3RpdGxlKCJIb25nIEtvbmcgSGlnaGVyIEVkdWNhdGlvbiBTdHVkZW50IEhlYWRjb3VudCIsIHN1YnRpdGxlPSIyMDA5IC0gMjAxOSIpICsgCiAgYW5ub3RhdGUoInRleHQiLCBsYWJlbD0iUmVjb3JkXG5IaWdoIiwgeD0iMjAxNy8xOCIsIHk9NTMwMCkgIyB5b3UgY2FuIGNoYW5nZSB0ZXh0IHBvc2l0aW9uIHZhbHVlIG9mIHggYW5kIHkgdG8gc2V0IHRoZSB0ZXh0IHBvc2l0aW9uCmBgYAoKIyMgQWRkaW5nIFJlZmVyZW5jZSBMaW5lcwpgYGB7cn0KbGV2ZWwuYmFyLnBsb3QgIyBkZWZhdWx0IHN0eWxlCgpsZXZlbC5iYXIucGxvdCArCiAgdGhlbWUocGFuZWwuYmFja2dyb3VuZCA9IGVsZW1lbnRfYmxhbmsoKSkgKyAjIHN0eWxpbmcgdGhlIHBhbmVsIGJhY2tncm91bmQgdG8gbm9uZQogIHRoZW1lKHBsb3QuYmFja2dyb3VuZCA9IGVsZW1lbnRfYmxhbmsoKSkgKyAjIHN0eWxpbmcgdGhlIHBsb3QgYmFja2dyb3VuZCB0byBub25lCiAgdGhlbWUocGFuZWwuZ3JpZC5tYWpvci55ID0gZWxlbWVudF9saW5lKGNvbG9yPSJncmV5IikpICsgIyBzdHlsaW5nIHRoZSBncmlkIGxpbmUgZm9yIHktYXhpcwogIHlsYWIoIk51bWJlciBvZiBTdHVkZW50IikgKyAjIExhYmVsIGZvciBZIGF4aXMKICB4bGFiKCJZZWFyIikgKyAjIExhYmVsIGZvciBYIGF4aXMKICB0aGVtZShsZWdlbmQucG9zaXRpb249InRvcCIpICsKICBzY2FsZV9maWxsX21hbnVhbCh2YWx1ZXM9YygicHVycGxlIiwgIm9yYW5nZSIsICJibHVlIiwgInRvbWF0byIpLAogICAgICAgICAgICAgICAgICAgIGd1aWRlID0gZ3VpZGVfbGVnZW5kKHRpdGxlPSJMZXZlbCBvZiBTdHVkeSIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxhYmVsLnBvc2l0aW9uID0gImJvdHRvbSIpCiAgICAgICAgICAgICAgICAgICAgKSArICMgbW92ZSBsZWdlbmQgcG9zaXRpb24gdG8gdG9wIGFuZCBsYWJlbCBwb3NpdGlvbiB0byBib3R0b20gCiAgZ2d0aXRsZSgiSG9uZyBLb25nIEhpZ2hlciBFZHVjYXRpb24gU3R1ZGVudCBIZWFkY291bnQiLCBzdWJ0aXRsZT0iMjAwOSAtIDIwMTkiKSArIAogIGFubm90YXRlKCJ0ZXh0IiwgbGFiZWw9IlJlY29yZFxuSGlnaCIsIHg9IjIwMTcvMTgiLCB5PTUzMDApICsgIyB5b3UgY2FuIGNoYW5nZSB0ZXh0IHBvc2l0aW9uIHZhbHVlIG9mIHggYW5kIHkgdG8gc2V0IHRoZSB0ZXh0IHBvc2l0aW9uCiAgZ2VvbV9obGluZSh5aW50ZXJjZXB0PTMyMDApICsgIyBhZGRzIGhvcml6b250YWwgbGluZQogIGdlb21fdmxpbmUoeGludGVyY2VwdCA9ICIyMDE3LzE4IiwgY29sb3I9IndoaXRlIikgIyBhZGRzIHZlcnRpY2FsIGxpbmUKICAKYGBgCgoKIyMgVXNpbmcgVGhlbWVzCmBgYHtyfQpsZXZlbC5iYXIucGxvdCAjIGRlZmF1bHQgc3R5bGUKCmxldmVsLmJhci5wbG90ICsKICB0aGVtZV9idygpICMgYmxhY2sgYW5kIHdoaXRlIHRoZW1lCgpsZXZlbC5iYXIucGxvdCArCiAgdGhlbWVfbWluaW1hbCgpICMgYmxhY2sgYW5kIHdoaXRlIHRoZW1lCgpsZXZlbC5iYXIucGxvdCArCiAgdGhlbWVfZGFyaygpICMgYmxhY2sgYW5kIHdoaXRlIHRoZW1lCmBgYAoKIyMgIE1vcmUgM3JkLXBhcnR5IFRoZW1lcwpJbnN0YWxsICoqZ2d0aGVtZXMqKiBwYWNrYWdlIHRvIHVubG9jayB3aWRlciBzZWxlY3Rpb25zIG9mIHRoZW1lcy4KCmBgYHtyfQppZiAoIXJlcXVpcmUoInBhY21hbiIpKSBpbnN0YWxsLnBhY2thZ2VzKCJwYWNtYW4iKSAjIGNoZWNrIGlmIHBhY21hbiBhbHJlYWR5IGluc3RhbGxlZC4gSWYgbm90LCBpbnN0YWxsIGl0LgpwYWNtYW46OnBfbG9hZChnZ3RoZW1lcykKCmxldmVsLmJhci5wbG90ICMgZGVmYXVsdCBzdHlsZQoKbGV2ZWwuYmFyLnBsb3QgKwogIHRoZW1lX2V4Y2VsKCkgKyAjIEV4Y2VsIFRoZW1lCiAgZ2d0aXRsZSgiRXhjZWwgVGhlbWUiKQogIAoKbGV2ZWwuYmFyLnBsb3QgKwogIHRoZW1lX3dzaigpICsgIyBXYWxsIFN0cmVldCBKb3VybmFsIFRoZW1lCiAgZ2d0aXRsZSgiV2FsbCBTdHJlZXQgSm91cm5hbCBUaGVtZSIpCgpsZXZlbC5iYXIucGxvdCArCiAgdGhlbWVfZWNvbm9taXN0KCkgKyAjIEVjb25vbWlzdCBUaGVtZQogIGdndGl0bGUoIkVjb25vbWlzdCBUaGVtZSIpCgpsZXZlbC5iYXIucGxvdCArCiAgdGhlbWVfZml2ZXRoaXJ0eWVpZ2h0KCkgKyAjIEZpdmUgVGhpcnR5IEVpZ2h0CiAgZ2d0aXRsZSgiRml2ZSBUaGlydHkgRWlnaHQgVGhlbWUiKQoKYGBgCgoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgojIE1PUkUgUkVTT1VSQ0VTIE9OIGdncGxvdDIKCiMjIG9mZmljaWFsIHdlYnNpdGUKYGBge3J9CmJyb3dzZVVSTCgiaHR0cHM6Ly9nZ3Bsb3QyLnRpZHl2ZXJzZS5vcmcvIikKYGBgCgojIyBleHRlbnRzaW9ucwpgYGB7cn0KYnJvd3NlVVJMKCJodHRwczovL2V4dHMuZ2dwbG90Mi50aWR5dmVyc2Uub3JnLyIpCmBgYAoKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKCiMgTU9ERUxJTkcKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKCiMgVE8gQ09OVElOVUUKCiMjIHVubmVzdCgpCgojIyBDYXRlZ29yaWNhbCBWYXJpYWJsZQoKIyMgUmVjb2RpbmcgRGF0YQoKIyMgU2NhbGluZwoKIyMgVHJhbnNmb3JtaW5nIE91dGxpZXJzCg==